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ABSTRACT 

We consider Zador's asymptotic formula for the distortion-rate function for a variable-rate 
vector quantizer in the high-rate case. This formula involves the differential entropy of the source, 
the rate of the quantizer in bits per sample, and a coefficient G which depends on the geometry 
of the quantizer but is independent of the source. We give an explicit formula for G in the case 
when the quantizing regions form a periodic tiling of n-dimensional space, in terms of the volumes 
and second moments of the Voronoi cells. As an application we show, extending earlier work of 
Kashyap and Neuhoff, that even a variable-rate three-dimensional quantizer based on the "A15" 
structure is still inferior to a quantizer based on the body-centered cubic lattice. We also determine 
the smallest covering radius of such a structure. 
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1. Introduction 

Zador gave two asymptotic formulae for the distortion-rate function for a vector quantizer in 
W 1 , depending on whether a fixed- or variable-rate code is used to transmit which cell the sample 



point belongs to. These are treated as cases (A) and (B) in [15]. See also Equations (19) and (20) 
in 0. In the present note we are concerned with the variable-rate case. Zador's formula for this 
case states that the distortion-rate function has the form 

6(R) = G2 2h{ - x h~ 2R , (1) 
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where S(R) is the average squared error per symbol, h{X) is the differential entropy per dimension 
of the source X, R bits/symbol is the rate of the quantizer, and G depends on the quantizer but 
not on the source. This is from page 4 of [15] and Equation (20) in |7). Note that, as pointed out 
in 0], the version of Eq. (1) given in [16] is incorrect. For further information see also [14] and Q, 
Chapter 5. The value of G can therefore be used to compare different quantizers. To calculate G 
we may choose any convenient distribution for the source X. 

Suppose first that the quantizer points form a lattice A C ]R n , with Voronoi cell V of volume 



V = \J det A. To calculate G we assume that X is uniformly distributed over V. Then G becomes 

r _ 1 Jy \\A?dx 

U ~ n yi+2/n ' W 

the familiar expression for the average mean squared error per dimension of a lattice quantizer (Q, 
[Q, Chap. 2], pi Chap. 10], ||, Chap. 5]). In this case all the quantizing cells have the same volume, 
and the fixed-rate and variable-rate versions of Zador's formula coincide. 

The main purpose of this note is to put on record an analogue of (|2|) (see Eq. (|8|) and (||)) 
for the variable-rate Zador formula which applies to the case when the quantizing regions form a 
periodic tiling of R n , such as that formed by the Voronoi cells for a union of a finite number of 
translates of a lattice. This question arose in a recent investigation of quantizers that are based on 



writing a lattice as an intersection of several simpler lattices [11]. 

A second motivation for our work was a recent paper of Kashyap and Neuhoff ||, which makes 



use of a fixed-rate analogue of @ for periodic lattice quantizers (see Eq. ( |i0| ) and (14) below). 
One of the goals of |8| was to see if the A15 arrangement of points in K 3 that has recently arisen in 
several different contexts (||, [fTo"! , fl^| , fi~3|l ) could produce a better three-dimensional quantizer 
than the body-centered cubic (bcc) lattice. The latter is known to be the best lattice quantizer in 
M 3 Q, but the question of the existence of a better nonlattice quantizer remains open. 

Kashyap and Neuhoff || found that with their figure of merit the best quantizer based on the 
A15 arrangement is inferior to the bcc lattice. In Section 3 we repeat the comparison using our 
figure of merit. Now a different version of the A15 quantizer is best, but is still inferior to the bcc 
lattice. 



Other applications of our formula will be found in [11|. 

Another open problem in three-dimensional geometry is to determine the best covering of M 3 
by equal (overlapping) spheres. In Section 3 we determine the smallest covering radius that can be 
achieved with the A15 structure. This is also (slightly) worse than that of the bcc lattice. 
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2. Periodic quantizers 



Consider a vector quantizer in M. n in which the quantizing regions form a periodic tiling. Let V 
be a minimal periodic unit or tile for the tiling, and let "Pi, . . . , Vk be a list of the different polytopes 
occurring among the quantizing regions. Let a be the centroid of V%. In order to determine G we 
assume the source X is uniformly distributed over V, and let pi (i = 1, . . . , k) be the probability 
that X is in a cell of type V%- Also let iVj = piV/Vi, where Vi = volVi and V = vol V. Then iVj is 
the number of cells of type Vi per copy of V, and 

V = NiVi + ■■■ + N k V k . (3) 

For example, let A C R n be a lattice and let a± + A, . . . , a r + A (a^ G M. n ) be distinct translates. 
Then the Voronoi cells for the union of the points a, + A (i = 1, . . . , r) form a quantizer of the type 
considered here. 

We now apply ([!]). The left-hand side is the normalized mean squared error per dimension 
U I (nV), where 

^=Ew* = vi;^ (4) 



and 

a; 



/ (5) 



is the unnormalized mean squared error over a cell of type Vi- 
The differential entropy per dimension is 

h(X) = - log 2 V, so 2 2h ^ = V 2 l n . (6) 
n 

It remains to calculate the rate R of the quantizer. Observe that we need H(p\, . . . ,p k ) = 
— Yli=iPi l°g2P« bits to specify the type of cell to which the quantized point belongs, and a further 
Y^t=\ Pi 1°S2 Ni = X^i=i Vi log2(PiW^i) bits to specify the particular one of the Ni cells of that type. 
This requires a total of log 2 V — Yli=iPi 1°§2 Vi bits, and then R is this quantity divided by n, so 
that 

k 

2 -2R = y-2/n JJ y^/n _ 
i=l 

We substitute (|), (|), © into (|) to get our expression 

G= ^ l=1 V > 2 , (8) 



n 



(nti 



for the average mean squared error per dimension using variable-rate coding. The numerator of (|8|) 
is equal to U/V (see @), so we may rewrite (||) as 

G = U - . (9) 

nVllLiV* Pi/n 

In contrast, the expression given by Kashyap and Neuhoff for fixed-rate coding is the follow- 
ing. Suppose the basic tile V contains L cells, Q±,... ,Ql, not assumed to be distinct, where Qi 
has volume Vi and unnormalized second moment Ui (as in ©). Then their expression is 

r2/nv^i tj. 

G= L \l=}\ (10) 

n yl+2/n ' ^ > 

where V = vol V. The following justification is equivalent to the one in ||, but clarifies the difference 
between our two approaches. Consider a large region of space, B, which is partitioned into A copies 
of V, and let X be uniformly distributed over B. The left-hand side of (H) is 

nvo\B nV { ' 

The differential entropy per dimension is 

MX) = iWvolB), so 2 2ft W = (AT/) 2/n . (12) 
n 

To compute the rate, it may be argued that log 2 A bits are required to specify the copy of V, and 
log 2 L bits to specify which of the Qj's the point belongs to. This requires a total of log 2 XL bits, 
so R = (1/n) log 2 XL, and 

2- 2R = (XL)- 2 ' n . (13) 
Arguing as before, we substitute (0)-(0) into (|), which gives 

If there are k different types of cells among the Qi, with the j-th cell occurring Nj times, then 
di~0| ) can be written as 

Eti nA u 



G = t-tt, • (14) 

n yl+2/n V > 

The ratio of the two expressions, © divided by (0), can be written as 

2^( 1 °62 i ~ T,i=iPi lo &2(Pi/ N i)) _ (15) 



Both formulae, (J9|) and (|14[), depend only on the geometry of the quantizer. The difference between 
the two expressions arises because, as long as the cells do not all have the same volume, variable- 
length coding can take advantage of the different cell probabilities to reduce the overall rate. 



If all cells have the same volume then (||) and (|l4|) coincide, and if there is only type of cell 
then they both reduce to (ph. 



In general, the fact that (|9|) is less than equal to (14) can be shown directly After canceling 
some common factors and rearranging, we must show that 

IK's^ 

and this follows from the geometric-mean harmonic-mean inequality. 



Ek ft ' 
i=l Vi 



3. Quantizers based on the A15 structure 

The A15 structure was discovered by Kasper et al. Q in the clathrate compound NasSi46. It 
was used by Weaire and Phelan ( []l3| ; see also []T2j l) to construct a counter-example to Kelvin's 
conjecture on minimal surface soap films. It was also used by Lagarias and Shor [[h]] to construct 
counter-examples to Keller's conjecture in dimensions 10 and above. Since the soap film problem 
attempts to find a partition of space into cells which are good approximations to spheres, it was 
therefore natural to ask if the A15 structure could also lead to a record-breaking quantizer in three 
dimensions. 

The A15 structure may be defined as the union of eight translates of the cubic lattice 4Z 3 by 
the vectors (0,0,0), (2,2,2), (Oil, 2), (2,0, ±1), (±1,2,0). (The first two translates alone give the 
bcc lattice.) 

There are two types of points in this structure, the even points in which all coordinates are 
even, and the odd points in which some coordinate is odd. There are isometries of M 3 which map 
A15 to itself and act transitively on the even points and on the odd points. However, even points 
are not equivalent to odd points. 

Weaire and Phelan consider a weighted Voronoi decomposition of M 3 : walls between points of 
the same type occur along perpendicular bisectors, but a wall between an even point E and an odd 
point D is defined by the plane 

(X — E) ■ (D — E) = n{D -E)-(D-E) , 

where [i is a weighting factor to be determined. For < fj, < 3/5 there are two types of Voronoi 
cells: 12-sided polyhedra V\ centered at the even points and 14-sided polyhedra V2 centered at 
the odd points. Weaire and Phelan use the "Surface Evolver" computer program of Brakke Q to 
perturb the polyhedra so that they have equal volumes and minimal total surface area. 



Kashyap and Neuhoff (|| use the weighted Voronoi decomposition based on the A15 structure, 
but adjust /j, to give the smallest value of (|io|). The formula are simpler if we set fi = 2a/ 5. Then 
Kashyap and Neuhoff find (and we have confirmed) that 

Vi = vol Pi = 4a 3 , 

V 2 = vo\V 2 = |(8 -a 3 ) , 

" = f s - 

U 2 = — (1200 - 600a 3 + 360a 4 -71a 5 ). 
90 

The fundamental tile V has volume V = 64, and L = 8, Ni = 2, N2 = 6, pi = a 3 /8, p 2 = 1 — a 3 /8. 
Then ( [Tc| ) becomes 

_^_i_ 7 _il = _ (10 - 5^ + 3.0). (16) 

This has a minimal value of 0.07873535... at a = 5/4. For comparison, the values of G for 
the bcc and fee (face-centered cubic) lattices are 19/(192 • 2 1 / 3 ) = 0.07854328... and 2~ n / 3 = 
0.07874507..., respectively (|], @, §). 
Using our formula (|8|) we find that 

i92(y 1 a3/ V 2 1 - Q3/8 )2/3 1 j 

which has a minimal value of 0.07872741... at a = 1.2401.... This is slightly better, but still 
inferior to the bcc lattice. 

Another unsolved problem is to find the best covering of M 3 by overlapping spheres (cf. ||], 
Chap. 2, Table 2.1]). The bcc lattice is the best lattice covering, with thickness 1.4635 . . ., but the 
question of the existence of a better nonlattice covering remains open. We find that the covering 
radius of the weighted Voronoi decomposition of A15 is minimized at a = 5/4, which gives a 
thickness of 

"* = LW... . 

432 

just slightly worse than that of the bcc lattice (but again better than the fee lattice, which has 
thickness 2.0944. . .). 
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